BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Transcription events by Approx. Span matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] Transcription 137 ( 54) 78 ( 54) 39.42 69.23 50.23
[VIBGhent ] Transcription 137 ( 54) 89 ( 54) 39.42 60.67 47.79
[JULIELab ] Transcription 137 ( 49) 79 ( 49) 35.77 62.03 45.37
[ UTokyo ] Transcription 137 ( 49) 104 ( 49) 35.77 47.12 40.66
[ UAveiro ] Transcription 137 ( 46) 112 ( 46) 33.58 41.07 36.95
[ NICTA ] Transcription 137 ( 31) 43 ( 31) 22.63 72.09 34.44
[ Team 24 ] Transcription 137 ( 38) 89 ( 38) 27.74 42.70 33.63
[ UNSW ] Transcription 137 ( 40) 103 ( 40) 29.20 38.83 33.33
[ SCAI ] Transcription 137 ( 32) 62 ( 32) 23.36 51.61 32.16
[UAntwerp ] Transcription 137 ( 34) 82 ( 34) 24.82 41.46 31.05
[CNBMadrid] Transcription 137 ( 67) 339 ( 67) 48.91 19.76 28.15
[ UNIMAN ] Transcription 137 ( 21) 31 ( 21) 15.33 67.74 25.00
[ConcordU ] Transcription 137 ( 21) 35 ( 21) 15.33 60.00 24.42
[ASU+HU+BU] Transcription 137 ( 22) 52 ( 22) 16.06 42.31 23.28
[CCP-BTMG ] Transcription 137 ( 18) 20 ( 18) 13.14 90.00 22.93
[ UZurich ] Transcription 137 ( 31) 148 ( 31) 22.63 20.95 21.75
[ PIKB ] Transcription 137 ( 19) 38 ( 19) 13.87 50.00 21.71
[UT+DBCLS ] Transcription 137 ( 23) 77 ( 23) 16.79 29.87 21.50
[ Cam ] Transcription 137 ( 17) 30 ( 17) 12.41 56.67 20.36
[ USzeged ] Transcription 137 ( 28) 150 ( 28) 20.44 18.67 19.51
[ Team 09 ] Transcription 137 ( 16) 47 ( 16) 11.68 34.04 17.39
[ UMich ] Transcription 137 ( 66) 696 ( 66) 48.18 9.48 15.85
[ KoreaU ] Transcription 137 ( 12) 43 ( 12) 8.76 27.91 13.33
[CIPS-ASU ] Transcription 137 ( 17) 133 ( 17) 12.41 12.78 12.59
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ Team 24 ] Transcription 137 ( 38) 89 ( 38) 27.74 42.70 33.63
[UAntwerp ] Transcription 137 ( 34) 82 ( 34) 24.82 41.46 31.05
[CNBMadrid] Transcription 137 ( 67) 339 ( 67) 48.91 19.76 28.15
[ASU+HU+BU] Transcription 137 ( 22) 52 ( 22) 16.06 42.31 23.28
[CCP-BTMG ] Transcription 137 ( 18) 20 ( 18) 13.14 90.00 22.93
[UT+DBCLS ] Transcription 137 ( 23) 77 ( 23) 16.79 29.87 21.50
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------